The Generalized Bregman Distance

نویسندگان

چکیده

Recently, a new kind of distance has been introduced for the graphs two point-to-set operators, one which is maximally monotone. When both operators are subdifferential proper lower semicontinuous convex function, this specializes under modest assumptions to classical Bregman distance. We name generalized distance, and we shed light on it with examples that utilize other most natural representative functions: Fitzpatrick function its conjugate. provide sufficient conditions convexity, coercivity, supercoercivity: properties essential implementation in proximal point type algorithms. establish these results left right variants construct closely related Kullback--Leibler divergence, was previously considered context distances whose importance information theory well known. In so doing, demonstrate how compute difficult conjugate discover occurrences Lambert ${\mathcal W}$ optimization growing interest.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Generalized minimizers of convex integral functionals, Bregman distance, Pythagorean identities

Integral functionals based on convex normal integrands are minimized subject to finitely many moment constraints. The integrands are finite on the positive and infinite on the negative numbers, strictly convex but not necessarily differentiable. The minimization is viewed as a primal problem and studied together with a dual one in the framework of convex duality. The effective domain of the val...

متن کامل

Generalized Nonnegative Matrix Approximations with Bregman Divergences

Nonnegative matrix approximation (NNMA) is a recent technique for dimensionality reduction and data analysis that yields a parts based, sparse nonnegative representation for nonnegative input data. NNMA has found a wide variety of applications, including text analysis, document clustering, face/image recognition, language modeling, speech processing and many others. Despite these numerous appli...

متن کامل

Klee sets and Chebyshev centers for the right Bregman distance

We systematically investigate the farthest distance function, farthest points, Klee sets, and Chebyshev centers, with respect to Bregman distances induced by Legendre functions. These objects are of considerable interest in Information Geometry and Machine Learning; when the Legendre function is specialized to the energy, one obtains classical notions from Approximation Theory and Convex Analys...

متن کامل

Distributed Bregman-Distance Algorithms for Min-Max Optimization

We consider a min-max optimization problem over a time-varying network of computational agents, where each agent in the network has its local convex cost function which is a private knowledge of the agent. The agents want to jointly minimize the maximum cost incurred by any agent in the network, while maintaining the privacy of their objective functions. To solve the problem, we consider subgra...

متن کامل

Generalized Statistics Framework for Rate Distortion Theory with Bregman Divergences

A variational principle for the rate distortion (RD) theory with Bregman divergences is formulated within the ambit of the generalized (nonextensive) statistics of Tsallis. The TsallisBregman RD lower bound is established. Alternate minimization schemes for the generalized Bregman RD (GBRD) theory are derived. A computational strategy to implement the GBRD model is presented. The efficacy of th...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Siam Journal on Optimization

سال: 2021

ISSN: ['1095-7189', '1052-6234']

DOI: https://doi.org/10.1137/19m1288140